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Q , Abstract: Hemaspaandra, Hempel, and Wechsung | HHW95 | raised the following 

^^ I questions: If one is allowed one question to each of two different information sources, does 

the order in which one asks the questions affect the class of problems that one can solve 
with the given access? If so, which order yields the greater computational power? 
r) , The answers to these questions have been learned — inasfar as they can be learned 

r) [ without resolving whether or not the polynomial hierarchy collapses — for both the 

^ I polynomial hierarchy and the boolean hierarchy. In the polynomial hierarchy, query order 

^, ' never matters. In the boolean hierarchy, query order sometimes does not matter and, unless 

the polynomial hierarchy collapses, sometimes does matter. Furthermore, the study of query 
order has yielded dividends in seemingly unrelated areas, such as bottleneck computations 
Tij- I and downward translation of equality. 

^? ' In this article, we present some of the central results on query order. The article is 

^^ ■ written in such a way as to encourage the reader to try his or her own hand at proving 

some of these results. We also give literature pointers to the quickly growing set of related 
results and applications. 



1 Introduction 



^ ■ So, you're at a theory conference and the coming session strikes you as potentially boring. 

3 . You walk into the lobby in search of more coffee and some theoretical chit-chat, and you 

get more than you bargained for. Poof! A well-dressed stranger appears seemingly from 
nowhere. His name tag is hidden under a lapel. Under his arm is a stack of books. A second 
edition of Garey and Johnson? The Polynomial Hierarchy Does Not Collapse by M. Sipser 
and A. Yao? Who is this guy? You don't have a clue. Wait a moment... is that Volume 4 
of Knuth under his arm? Aha! Clearly, this is a time-traveler from the distant future! 
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Stranger: These books will all be yours if you can solve the following small puzzle. 
Here are two black boxes. One is marked SAT, and in unit time it solves satisfiability 
(using magical means not widely available in the 20th century). The other black 
box is marked lEI, and in unit time it solves the well-known NP -complete problem 
Integer Expressionlnequivalence (again using magic). I'll ask you to write a polynomial- 
time algorithm that accepts the language FOO, and that on each input makes at most one 
query to each of the black boxes. Actually, at this moment I don't demand that you write 
the algorithm. I just want you to decide on a fixed order in which you will access the black 
boxes. Either you must (right now) commit to accessing SAT first on each input, or you 
must (right now) commit to accessing lEI first on each input. 
You: Well, before I commit, will you tell me a bit about what problem FOO is? 
Stranger: No. 

You: Oh. Wait a second. You're trying to trick me. NP^^ (as captured by its complete 
set, lEI) is much more powerful than NP (as captured by its complete set, SAT). So for both 
classes you are speaking of the query to SAT is superfiuous. That is: p^^^l^J = piELSAT _ 
pSAT:lEl^ where "[!]" indicates one query and P^-^ indicates a P machine making at most 
one query to (the set) A set followed by at most one query to (the set) B. 
Stranger: False! Your reasoning is tempting, but is not valid. In fact, that weak SAT 
query provably gives strictly more computational power, as you would know if you had read 
a certain BEATCS article ^HH97a] and had applied it in light of the Sipser-Yao book 



under my arm. 

You: I've got you now, as I did read that obscure little article! I retract the p^^^^^l = 

P claim I just made, but I reassert the pi^i-SAT _ pSAT:iEi g^g^^jj^i Order does not 

matter here, and so either order I commit to now will leave it equally likely that FOO can 

be solved via the given access order! 

Stranger: Sheesh... I thought no one except the authors and the editor had read that 

column. Well, you've beaten me so here are your books. 

You: But this Sipser-Yao book is from the year 2010. If I just steal their result and proof, 

and publish them now, won't that change the future and cause the book never to be written, 

in which case how can I be meeting you and receiving this book in the first place? 

Stranger: (Suddenly starts fading away, but before he disappears you hear) I commend 

to you the Nebula- Award- winning book Timescape [Bcn8C[, which also has quite a bit to say about 

curiosity-driven research, scientific ctliics, and... 

You suddenly feel a bit disoriented and — distractedly tossing the books into a trash bin 
and mumbling about swearing off that ninth cup of coffee — you go back into the lecture 
hall and listen with half-hearted attention to an in-progress lecture on query order. 

2 Query Order in the Polynomial Hierarchy 



2.1 Results 



Recall from the introduction that, for any sets A and B, p^-^ denotes the class of languages 
that can be accepted via P machines making at most one query to A followed by at most 
one query to B. Similarly, for any classes C and V, p^-^ denotes the class of languages that 
can be accepted via P machines making at most one query to a set from C followed by at 
most one query to a set from D. That is. 
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These notions and notations were introduced by Hemaspaandra, Hempel, and 



Wechsung |HHW95|, who studied them for the case in which C and T) are levels of the 
boolean hierarchy (see Section |3|); in brief, they proved that query order usually does matter 
in the boolean hierarchy. 

Hemaspaandra, Hemaspaandra, and Hempel | HHH96b , HHH97b[ ] , following up on the 
concept of query order, asked whether query order also matters in the polynomial hierarchy. 
What they found was that query order never matters in the polynomial hierarchy. This is 



stated formally below as Theorem 2.2. 



Definition 2.1 ptoT^ 



1. Eg = P. 



,s? 



2. For each fc> 0, E^ = NP^'=-i. (For example, YF^ = NP and S^ = NP^^.) 

3. PH= U TP 



k>0 



k- 



Theorem 2.2 |HHH97b| For each i,j > 0, 



P i 3 ^ i:" 3 » . 



In fact, in all but the "diagonal" cases of this theorem (where order elimination is 
impossible unless the polynomial hierarchy collapses), one can eliminate order entirely: 



Theorem 2.3 lHHH97bi For each i,i > with i / j. 



-'^la-tt — ^ 3 — r J , 



(SP,SP) 



where P^ l_^^-' denotes the class of languages accepted by machines that, in parallel (i.e., 
simultaneously), ask at most one question to a S? set and at most one question to a YR set. 
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However, we should now address the "tempting" worry you, the reader, raised during 
the introduction. Let i < j. Clearly, S^ can beat S? into a pulp. For example, it is well 
known that P^* C S^. That is, S^ is more powerful than even a polynomially long series of 

adaptive queries to S^. So it would indeed be tempting to assert: P '' ^ = P ^ ' ' for i < j, 
and indeed there is an obvious (but flawed) "proof" of this, involving having T,^ simulate the 

S^ query of P ' ' ^ , get the answer, and then simulate the T,^ query of P ' ' ^ . The flaw is 
that though E^ can do this, it cannot pass to the base P machine the information on which 
truth-table to use to process its answer; there is a 1-bit information bottleneck! Indeed, 
the tempting equality — P » ' j = P J^ ' for i < j — is outright false unless the polynomial 
hierarchy collapses. This follows immediately from the more general fact that all "ordered 
access to the polynomial hierarchy" classes are either trivially equal or are truly different 
(unless the polynomial hierarchy collapses). 



i;P:SP 



Theorem 2.4 iHHH97b| Let i,j,e,m > 0. If P^^' j = p^^^^-, then either {i,j} 



{i, m} or the polynomial hierarchy collapses. 

The just-stated theorem merely concludes that the polynomial hierarchy collapses 
(unless {i,j} = {i,m}). In fact, in almost all cases, the polynomial hierarchy collapses 
to an alarmingly low level — one that a priori seems lower than either of the classes 



mentioned in the theorem (this can be seen easily from HHII , BF96 , HIIII97d , HHH97b | , 
see especially [ HHH97b| , Section 3.2]). For example. 



VP -VP ^P -VP r^ 

p-^1997-^1999 = P^1998-^1999 =^ PH = Siqqq, 

even though a priori one would suspect that S^ggg is strictly contained in P^i997-^i999. 

Note that in all the results we have discussed so far, we have a P machine doing the 
querying, i.e., pSAT:iEi _ piELSAT ^^ fact, Hemaspaandra et al. piHH96b| ] have shown 
that all standard complexity classes (in particular, all leaf-definable classes) automatically 
inherit all query-order containments that hold for P machines. Thus, for example, since 

we may conclude immediately that ppNP:NP _ ppf 



JNPINPNP _ T3NPNP;NP „,„ _„„ „„„„1„^„ ; ^;„+„l,. +T,„-f T3T3NP:NPNP _ T3T3NPNP:NP 



2.2 Proof by Example 

Our goal here is just to give the general flavor of a proof related to query order in the 



polynomial hierarchy. We will prove part of an instance of Theorem |2.2| . That is, we will 
partially prove: 

In particular, we will prove that X C pNP:22 ^ -v^^here X is the class of languages that are 
in P^2-^P via a P^2-'^P machine in which the P machine on each input asks exactly one 
question to each of its oracles, and in which the P machine accepts if and only if exactly 
one of its two queries gets the answer "yes. " That is, we will do the parity case. 



qeAl 




Figure 1: A possible behavior of M(x) (applies to Section 2.2 and Section 3.2) 



The proof is not hard, and finding it for oneself will help one gain a feeling for what it 
is like to study query order. Thus, we urge the reader to try to prove this him- or herself 
before reading the proof we include below. 

Proof: Let L G p^^^NP^ l^^. m be a P machine, A G S^, and B G NP be such that M 
accepts L and, on each input, M makes exactly one query to A followed by exactly one 
query to B. (This does not rule out the possibility that were M{x) to be given an incorrect 
answer to its first query it would not ask a second query. However, without loss of generality 
we can assume that it always asks exactly one query to each oracle, regardless of the answer 
to the first query. We do assume this both here and in the proof of Section p.2| .) We will 
partially describe a P machine M' that accepts L with one query to an NP set followed by 
one query to a Eg set. 

On input x, M' determines the first query of M{x) and the two potential second queries 
of M(x). We will write q for the first query asked by M{x), qy for the second query that 
would be asked by M(x) were it to receive a "yes" answer to the first query, and qjy for 
the second query that would be asked by M(x) were it to receive a "no" answer to the 
first query. M'{x) then determines for which of the four possible answers to two sequential 
queries (namely, "no/no," "no/yes," "yes/no," and "yes/yes") M{x) accepts. All this can 
be done in polynomial time without querying any strings. Since M{x) asks two queries, 
there are sixteen different possibilities for Accept /Reject behavior of M(x). As an example, 
suppose that M(x) accepts if and only if the answer to the first query differs from the 
answer to the second query (see Figure || for a pictorial representation of this case). 

In this case, M'{x) proceeds as shown in Figure ^. It is easy to see that M' accepts x 
if and only if M accepts x. In addition, note that the first query in Figure |2| is a query to 
an NP set, namely B, and that the two potential second queries "g G A A qy ^ B?" and 
"g G ^ A qy ^ BT are both Ti^ predicates. Since S2 is closed under disjoint union we 
are done for the case corresponding to Figure |l|. There are of course fifteen other cases to 
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Figure 2: Query structure of the pNP-^2 machine corresponding to Figure |l|. 



consider, but ah of these are similar to or easier than the case we just treated. We mention 
in passing that the full proof of Theorem 2.2 in |HHH97b] is more elegant than working 
through the sixteen different subcases and splicing them together dynamically; the present 
proof fragment is merely intended to convey some of the flavor of how one can prove things 
about query order. | 



3 Query Order in the Boolean Hierarchy 



3.1 Results 



The boolean hierarchy [|CGH"''8£ , CGH+89[| was introduced in the 1980s, and captures and 
classifies those languages that can be computed via finite hardware operating over NP 
predicates (equivalently, that can be computed via bounded access to SAT). 



Definition 3.1 

2. jCGH+J 



1. Let C e V = {Li - L2\ Li e C A L2 e V}. 



(a) BHo = P. 

(b) For each /c > 0, BHfc 



NP e BHfc. 



1- 



(c) BH, the boolean hierarchy, is defined as (J BH^. 

fc>0 



So BHi = NP, and BH2 equals Papadimitriou and Yannakakis's [PY84] class DP, namely 
the class of all sets that can be written as the intersection of some NP set with some coNP 
set. NP, DP, and the other levels of the boolean hierarchy contain a large variety of complete 
problems (see, e.g., lGJ79| , pM87l , pGH+88|jB^^ ]). 

Hemaspaandra, Hempel, and Wechsung |HHW95] raised the topic of query order by 
asking whether pBHiiBH^ _ pBHj:BHi_ xhey resolved this question as follows. They noted 
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Figure 3: Relationship between pBH,:BH, ^^^ pBHjiBH, 



Key: — in row i and column j 
< in row i and column j 

> in row i and column j 



means P«H.:BH, ^ pBH,:BH, 

means pBHi^BH^ j^ ^ ^^^.j^^ subset of pBHjiBH; 
unless the polynomial hierarchy collapses, 
means p^^i-^^i is a strict superset of pBHj^BH; 
unless the polynomial hierarchy collapses. 



that equahty triviahy holds if i = j V i = V j = 0. They proved that equality (not so 
trivially) holds if i is even A j = i + 1, or if j is even A i = j + 1. They proved that for 
all other cases inequality holds unless the polynomial hierarchy collapses. 



Theorem 3.2 [HHW95] For each i and j, the relationship between P 



BHj iBH^ 



and 



pBHjiBHi jg g^g shown in Figure |3[ 



The most strikingly odd feature of this theorem is that the just-off-diagonal entries 
alternate between equality and inequality (e.g., pBH2:BH3 _ pBH3:BH2^ yg|- unless the 
polynomial hierarchy collapses pBH3:BH4 -/. pBH4:BH3^_ rpj^^ curious asymmetry becomes 



a bit less opaque if one looks at what is actually underpinning Theorem 3.2. The key result 
on which Theorem 3.2 rests is Lemma p^ below, which states that ordered access to the 



boolean hierarchy's levels can without loss of generality be restructured as parallel access 
to NP. As is standard, let R^_^,.(NP) denote {L \ {3A £ NP)[L <l^^ A]}, where <l^^ is the 



standard reduction allowing £ parallel queries [ LLS75|] 



Lemma 3.3 For each i,j > 1, 

pBHiiBHj 



R(,+2,-i)-tt(NP) 
R(.+2,)-tt(NP) 



if i is even and j is odd 
otherwise. 



This lemma is the source of the asymmetry between, for example, 2-versus-3 and 3- 
versus-4. Of course, this in some way begs the question, as the reader may well ask about 
the asymmetry between the first and second cases of Lemma |3.3| . Briefly and informally 
put, when i is even and j is odd, a certain underlying graph modeling the computation of 
pBH,;:BHj ]3g(jomes non-bipartitc, and by doing so allows one to guarantee a savings of one 



parallel query to NP (see [[HHW95|| for full details). 



3.2 Proof by Example 



In this subsection we will give a partial proof for an instance of Lemma 3.3, namely, we will 
give a partial proof for 

pI^P^NP ^ RP_^^(NP). 

In particular, we will show that X C R3_^^.(NP), where X is the class of languages that are 
in pi-'P-NP via a pi-'P-NP machine in which the P machine on each input asks exactly one 
question to each of its oracles, and in which the P machine accepts if and only if exactly 



one of its two queries gets the answer "yes." That is, as was the case also in Section |2.2 , 
we will do the parity case. 

We warn the reader that the proof approach taken here is not suited to be elegantly 
generalized to eventually yield Lemma 3.3. For a complete and unified proof of pDP:NP ^ 



R3_^^.(NP), we refer the reader to [HHW95]. However, the proof given below provides a 



good starting point for understanding how these proofs work in the context of the boolean 
hierarchy. Note that the proof picks one of the interesting cases of Lemma |3.3| ( "z even and 
j odd"). As hands-on experience is the best way to get a feel for an area, we urge the reader 
to come up with his or her own proof before reading the proof below. 
Proof: Let L £ P^p^np^ ^^^ p j^achine M, A G DP, and S G NP be such that M accepts 
L and, on each input, M makes exactly one query to A followed by exactly one query to 
B. We will partially describe a P machine M' that accepts L with three parallel queries to 
an NP set. 

On input x, M' determines the first query and the two potential second queries of M(x). 



As in the proof of Section |2.2| , we will write q for the first query asked by M{x), qy for the 
second query that would be asked by M(x) were it to receive a "yes" answer to the first 
query, and q^ for the second query that would be asked by M(x) were it to receive a "no" 
answer to the first query. M'{x) then determines for which answers to its two queries M{x) 
accepts. All this can be done in polynomial time without querying any strings. Again, we 
will consider the case pictured in Figure |l], i.e., the case that M accepts x if and only if the 
answer to the first query differs from the answer to the second query. 

Let Ai,A2 G NP be such that A = Ai — A2- It is well-known that we may choose Ai 
and A2 to be such that Ai 5 A2 |CGII"'"88|. If we know the answers to the four NP queries. 



q G Ai, q G A2, qN £ -B, and qy G B, we can easily determine whether M{x) accepts or 



ge Ai ? 
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Figure 4: Refined query tree of M{x) — all queries drawn are NP queries. 

rejects. Thus we have pDP:NP ^ R^_^^(NP). How can we do better? In particular, how can 
we save one parallel NP query? 

Let us redraw the query tree of M(x) using the above-mentioned underlying four queries 
in the fashion shown in Figure ^ Recall that we are looking at the case in which M accepts 
X if and only if the answer to the first query differs from the answer to the second query. 
Since Ai D A2, ii q ^ Ai then q ^ A. 

The refined query tree of M{x) displays four regions of acceptance and rejection (see 
Figure 0). In order to correctly simulate M{x), it suffices to find out in which region the 
correct branch ends. However, this can be done with just three questions, namely: 

1. Does the correct branch end in region 2, 3, or 4? {q & Ai V qN ^ Bl) 

2. Does it end in region 3 or 4? {q ^ Ai A {q ^ A2 V qv & B)l) 

3. Does the correct branch end in region 4? (g G j4i A q £ A2 A qN £ Bl) 

The answers to these three questions determine the region in which the correct branch 
ends and hence we know whether M(x) rejects or accepts. In particular, M'{x) should 
accept if and only if the correct branch ends either in region 2 or region 4 (that is, if and 
only if either only question (1) is answered "yes" or all three questions are answered "yes"). 
Note that we use three different NP sets and also various "and"s and "or"s in the above 
description of the questions, but since NP is closed under union, intersection, and disjoint 
union, the three questions can be transformed (in polynomial time) into three single queries 
that in turn can be asked (in parallel) to one NP set. I 
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4 Related Work 

Sections ^ and ^ presented the basic results known about query order in the polynomial and 
boolean hierarchies. In a nutshell, query order never matters in the polynomial hierarchy, 
and in the boolean hierarchy we know in exactly which cases query order matters (assuming 
that the polynomial hierarchy does not collapse). 

However, via the study of query order, a number of results have been obtained regarding 
topics that at first blush might seem totally unrelated, such as bottleneck computation and 
downward translation of equality. Also, a number of researchers have generalized from "one 
query to a given class" to more elaborate settings such as tree-like query structures, multiple 
queries, and multiple rounds of multiple queries. In this section, we briefly provide pointers 
to these related topics and generalized settings. 

Translating Equalities Downwards 

Suppose two questions to S^ yield no new languages beyond those already solvable via one 
query to T,^. What follows? 

Until very recently, all one could conclude from this assumption was that the polynomial 
hierarchy collapses to a level slightly above one query to S^_,_j^ (note the "+1" here) | Kad88| , 



Wag87 , Wag89| , CK96 , BC093|] . However, work growing directly out of the study of query- 



order classes — namely, out of the goal of showing that different ordered access to levels 
of the polynomial hierarchy yields different language classes (see Theorem 2.4) — led to a 



collapse a full level lower in the polynomial hierarchy. In particular, the one-two punch 
of ||HHH96a|JlIIIll / pF96|| yielded the following theorem. 



Theorem 4.1 Let k > I. If P^fcl^l = F^l^'^\ then PH = S^. 

In other words, if P fe'^' = P^fc^^J, k > 1, the polynomial hierarchy crashes to a class that 
(before the crash) was seemingly even lower than that at which the hypothesis's equality 
stands. 

It has been shown [HHH,HHH97d| that the above theorem in fact has an analog for the 



j versus j + 1 queries case. In particular, we have the following, which like Theorem 4.1 was 



established in the literature via proving a more general theorem about query-order classes. 



and then deriving the stated result as a corollary to the more general theorem |HHH97d| 



Theorem 4.2 Let A; > 1 and m > 1. If P^^H = P^H^+i], then DIFF^(EP) = 
coDIFF^(SP). 

Again, this says that, under the stated assumption, there is a collapse within the boolean 
hierarchy to a level that, a priori, was just below P^fc'™!. 

In a nutshell, in this setting smaller classes collapse if and only if larger classes collapse — 
a type of behavior people have been stalking ever since influential papers of Book p3oo74 1 
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and Hartmanis, Immerman, and Sewelson |Har83,HIS85| raised the issue of when classes 
stand and fall together. 



Multiple Queries and Bottleneck Computations 

In this survey, we have focused on the most natural case: one query to each of the two 
information sources. A number of papers building on those mentioned here have studied 
more elaborate settings. 

In fact, the initial paper of Hemaspaandra, Hempel, and Wechsung |HIIW95 | already 
studied the case of general tree-like access to levels of the boolean hierarchy, and in doing 
so studied the case of multiple rounds of single queries; Beigel and Chang | BC97 | study 
multiple rounds of multiple queries to the polynomial hierarchy, and show that here the 



order does not matter, and they also study the case of function classes; Wagner [|Wag97 1 
studies parallel rounds of one or more queries to the polynomial hierarchy and other classes 



and also tightly relates such classes to the refined hierarchy work of Selivanov |Sel94,Sel95| 
(see also the discussion in the final paragraph of Section 2 of [HHH97^). 

In a quite different direction, bottleneck machines are a model used to study whether 
a computational problem can be decomposed into a large number of simple, sequential, 
tasks, each of which passes on only a very limited amount of information to the next 
task, and all of which differ only in that input and in a "task number" input [|CF91 |. A 
surprising recent paper of Hertrampf per97| uses ordered access involving multiple queries, 
combined with quantifier-based and modulo-based computation, to completely characterize 
the languages accepted by certain bottleneck machine classes — classes that had long eluded 
crisp characterization. 



Advice Classes, Self-Specifying Machines, and Completeness Types 

A number of other seemingly different notions are related to query order. Hemaspaandra, 
Hempel, and Wechsung |HHW97] have studied self-specifying machines — nondeterministic 
machines that dynamically specify the path sets on which they will accept. They 
completely characterize the two most natural such classes in terms of query-order classes 
with a "positive final query" restriction. They show that the classes have equivalent 
characterizations as the #P-closures of P and NP, respectively, and they establish a 
query order result mixing function and language classes: P#"^i| = p#P:NP ^^_^ 
p#P|iJ _ p#P:NP^C'(i)j ^-^iigpg "(J ; p" access means one query each except when 0(1) 
queries are explicitly stated for the queried class). They also show that the classes 
have characterizations in terms of the "input-specific advice" notation of Kobler and 
Thierauf [^T9§. 

Agrawal, Beigel, and Thierauf | ABT96 |, independently of | HHW95| ], also study input- 
specific- advice classes. As noted by Hemaspaandra et al. in the journal version of [HHW95 |, 
this can be seen as equivalent to studying query order with a "positive final query" 
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restriction — i.e., the machines must "do" exactly what the response to their second query 
is. A detailed and careful discussion of the relationship between the two papers can be 



found in the journal version of | HHW95 ]. 



Finally, a long line of research has asked whether <p^ -completeness and <5^- 
completeness stand or fall together for classes that potentially lack complete sets. 
Gurevich [Gur83| and Ambos-Spies [Amb86| have shown that, for all classes C closed 



downwards under Turing reductions, it holds robustly that: C has <Pj -complete sets if and 
only if C has <!^ -complete sets. Nonetheless, by studying a strong nondeterministic closure 
of NP that, it turns out, exactly equals the query-order class pNPncoNP:NP^ Hemaspaandra 
et al. have recently shown that on some reducibility closures of NP, <^ -completeness and 
<J[, -completeness do not robustly stand or fall together |HHH97c]. 
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